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ABSTRACT 

The results of testing some 1,265 first-grade 
students who took part in the Tutorial Reading Project for the full 
1968-69 school year in Indianapolis are reported. Subjects were 
selected from the lover third of the first grade, based on 
Hetropolitan Reading Readiness Test scores and teachers' judgments. 
Separate pretesting and post-testing was done for the 33 schools 
using the Ginn Basal Reader Series and for those six schools in which 
the Hacmillan Basic Reader Series was used. Two conclusions were 
reached after evaluating the test results. (1) The tutorial reading 
program continues to produce large and statistically significant 
improvement in reading achievement. Roughly equivalent gains were 
found for children tutored in Ginn material and for children tutored 
in an experimental program designed for use with the Hacmillan 
series. (2) A followup study of children tutored in 1966-67 and 
1967-68 shoved that the retention rate was significantly reduced by 
tutoring. Tables are included. (NH) 
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August 22 , 1969 

REPORT OF RESULTS OF TUTORIAL READING PROJECT 
Indiaiuipolls PiAllc Schools 
1968-1969 

Std>alttcd by: D. G. Ellsouy Depsrcnsnt of Psychology, Indians University 

The sill of this project vas two-fold; first, service, to provide individual 
instruction in reading as a supplement to classroom Instruction in first-grade 
classes, and second, evaluation, to obtain information concerning the effective- 
ness of the tutoring procedures and the optimum conditions for their use. 

The tutorial program for 1968-69 consisted of two parts. The major effort 
was a continuation of the prcgrams for previous years using Ginn Tutorial materials 
and tutoring procedures in 33 schools idiich used the Ginn Basal Reader Series in 
their first grade classrooms. In the remaining six schools, which ujei* the 
Nacmillan Basic Reader Series, the program served as a try-out of newly devised 
tutorirg procedures which utilised the Macmillan series and the workbooks idilch 
accompany it as tutoring materials. 

Fhnds were provided from two sources. The primary source, for service 
aspects of the project, wss ESEA Title 1 funds. These were used for payment of 
tutors, direct supervision and associated administrative services, and for scoring 
of tests used in evaluation of the results obtained. A smaller contribution was 
made through an Indiana University project supported by a research grant from the 
fdrd Foundation. Funds from this source provided for technical supervision and 
analysis of evaluation data. These arrangements were similar to those of the 
previous school year. 

In this project first-grade classroom instruction in reading was supplemented 
by one 15-minute session of nrogramed tutoring daily. Programed tutoring is a 
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te^mlqtM of individual instruction developed at Indiana University during the 
past nine years and field-tested in several Indiana school systees, including, 
since 1964, the Indianapolis Public Schools. It is a highly structured procedure 
uhich can be carried out effectively by nonprofessional persons but it is designed 
to be eaxieally sensitive to the individual learning diaracteristics of the 
Children who are taught. It is a teaching tedmique rather than a set of nateri- 
als so that the siAject natter taught can be detemined entirely by the curricular 
requirenents of the school system in uhich it is used. 

During the 1968-69 school year 33 of the 39 schools included in the Tutorial 
Heading Project used the Ginn Basal Beader Series in the first grade, and 6 schools 
used the HacmiUan Basic Reader Series. Tutoring in the schools using the Ginn 
series utilized the Ginn Tutorial Kit . In accord with the progran prescribed by 
Ginn Tutorial, sight-reading was tutored fron the basal reader series , whidi were 
also being used in the classrooms. Conorehension and word analysis was tutored 
fron books included in the Ginn Tutorial Kit . In schools using the Kacnillan 
Series, tutoring was based on ezperinental procedures whidi utilized the Hacnillan 
pre-primers, primer and first reader and the acconpanying workbooks. &idit- 
reading was tutored from the readers, conprehension end word analysis fron the 
workbooks. The results of the tutoring prograns based on the Ginn snd the 
Hscnillaa series are evaluated separately below. 

Described from the point of view of service, the 1968-69 project provided 
tutoring for a total of 1,711 children. They were chosen fron the lower third 
of the first grade (predicted from Hetropolitan Reading Readiness Test scores and 
teadiers* Judgments). Of these, 1,265 were tutored for the entire year. Others, 
who left school during the year and those who replaced these drop-outs on the 
recommendations of teachers, were tutored for part of the year, averaging approxi- 
nately one -half year, and others were tutored during the sunner. The breakdiown 
is suenarized in Table 1. 
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TABLE 1 

CHILDREN TUTORED IN 1968-69 



Duration of Tutoring 


Ginn 


Macmillan 


Total 


Fbll school year 


1132 


133 


1265 


Part of school year 


268 


50 


318 


Summer, 1969 


128 


— 


128 


Total 


1528 


183 


1711 



The eveluatlon of the effectiveness of the tutoring program Is based pri- 
marily on cofl^arlsons of reading achievement test scores obtained at the end of 
the year for comparable samples of tutored and untutored children. Separate 
evaluations were made for the Ginn and Macmillan groups. 

Pre-testing and Selection of Children to be Tutored 

At the beginning of the year, children to be tutored and those Included In 
the untutored control groups were selected as follows. Assignments to the experi- 
mental (tutored) and control groups were based on Metropolitan Readiness Test 
scores. Locally devised and Individually administered vocabulary and alphabet 
tests were also given as pre-tests but not used for purposes of assignment to 
tutoring. 

Children were ranked within each school on the Metropolitan Reading Readiness 
Test scores (parts 1-4 of the Metropolitan Readiness test). They were then 
assigned In order, beginning with the lowest scores, to experimental and control 
groups In such a way that the two groups were comparable except In nuad>er of cases, 
and all available tutoring time was filled. Approximately one- third (the lower 
third) of the first-grade children In each school were tutored. The assignments 
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utte planned » allowing for drop'out rate of approximately 35 per cent, so that in 
the Ginn program approximately 100 children remained In the control group at the 
end of the year. In the Macmillan program an equal nunber of children were 
assigned to the experimental and control groups. 

The effectiveness of the matching procedures Is Indicated In Table 2, which 
sunsiarlzes pre~*test scores. No experlmental**control group differences were 
significant except that for the Ginn Vocabulary Recall Test, llie difference In 
this case favored the control group. 

TABLE 2 

PRE-^ST SCORES 



Mean 

Experimental Control Dlff. 



Tests 


M 


a- 


M 




iS^c) 


t 


p 


Ginn Evaluation* 














Met. Reading 
Readiness (Parts 1-4) 


19.65 


6.35 


19.74 


6.41 


-0.09 


.11 


H.S. 


Ginn Recall (Voc.) 


0.33 


1.40 


0.92 


2.40 


-0.54 


2.00 


<.05 


Alphabet 


3.90 


5.62 


3.76 


5.85 


0.14 


0.18 


N.S. 


Macmillan Evaluation^* 
















Met. Reading 
Readiness 


24.53 


7.94 


23.61 


8.55 


0.92 


0.90 


N.S. 


Macmillan 
Recall (Voc.) 


0.81 


1.78 


0.81 


1.77 


0.00 


0.00 


N.S. 


Alphabet 


6.85 


8.10 


6.87 


7.68 


-0.02 


0.02 


N.S. 



*N ■ 146 foj experimental groups 96 for control group for Ginn Recall and 
Alphabet Pre-tests; and 97 for control group for Met. Reading Readiness 
Pre-test. 

**N ■ 133 for experimental group, N * 132 for control group. 
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Mean scores on the Metropolitan Readiness test are low. Indicating that a 
high proportion of the children fall In the "poo^ risk" category. Scores on the 
vocabulary recall tests are also low. Indicating that the children can read very 
few of the words Included In the primer vocabulary. Scores on the alphabet test 
are higher. Indicating that many of the children have been taught to recognize 
some of the letters. 



Tutor! ag on Ginn Material 

At the end of the year the reading performance of children In the Ginn pro- 
gram was measured with the Ginn Vocabulary Recall test , the Alphabet test , the 
Ginn Pre-primer, Primer and First Reader Achievement tests, and the Metropolitan 
Adilevement Elementary Battery I (First Grade). 

Scores on these tests for the experimental and control groups are presented 
in Table 3, which also summarizes post-test data for the Macmillan study. These 
data are presented In greater detail on the attached report sheets. 

In the Ginn study, comparison of scores for experimental and control groups 
all of the Individual and combined test scores show significant differences In 
favor of the tutored group. Comparison of pre- aad post-test scores on the Ginn 
Vocabulary Recall and the Alphabet test Indicate large gains which are obviously 
statistically significant. 

It may be noted that the differences between scores on the Ginn Achievement 
Test scores for the experimental and control groups were smaller In 1968-69 than 
in the evaluation studies ©I the two preceding years. This change might be 
Interpreted as a decline In effectiveness of the tutoring program over this period 
If It were not for the fact that the mean scores for the tutored group show a 
progressive Increase over this period. The decrease In the difference scores Is 
apparently produced by an Increase In the mean scores for the control group. For 
example, total scores on the pre-primer and primer tests for the tutored groups 

o 
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TABLE 3 

POST-TEST SCORES 



Testa 


Experimental 
M 4T 


Control 
M <r 


Mean 

Dlff. 

(E-CJ 


t 




A. Ginn Evaluation* 
Ginn Recall (Voc.) 


11.78 


3.30 




4.81 


2.58 


4.61 


<.001 


Alphabet 


23.25 


5.5/ 


20.38 


9.07 


2.87 


2.79 


<.01 


Ginn Pre-primer 


25.03 


4,64 


22.26 


6.28 


2.77 


3.69 


<.001 


Ginn Primer 




13.20 


43.97 


15.71 


6.46 


3.33 


<.001 


Ginn First Reader 


56.57 


18.96 


50.47 


19.53 


6.10 


2.40 


<.02 


Pre-primer and 
Primer Total 


75.46 


16.08 


66.23 


21.15 


9.23 


3.63 


<.001 


Pre-primer, primer 
and First Reader Total 


132.03 


40.43 


U6.70 


42.61 


15.33 


2.79 


<.01 


Met. Ach., Elem. 
Battery I (1st Gr.) 


52.94 


13.78 


49.22 


14.60 


3.72 


1.98 


<.05 


B. Macmillan Evaluation** 
Macm. Recall (Voc.) 


13.31 


2.64 


10.92 


4.54 


2.39 


5.20 


<.001 


Alphabet 


23.62 


7.28 


21.81 


8.79 


1.81 


1.83 


N.S. 


Worlds of Wonder 


85.46 


25.92 


73.79 


27.69 


11.67 


3.53 


<.001 


Lands of Pleasure 


80.56 


28.61 


72.93 


26.85 


7.63 


2.23 


<.05 


Worlds of Wonder and 
Lands of Pleasure 
Total 


166.02 


53.19 


146.72 


53.01 


19.30 


2.95 


<.01 



*M “ 146 for experimental group; N ■> 97 for control group. 

**N ■ 133 for experimental group; H ■ 132 for control group 
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vtre 71.9 In 1967, 75.5 In 1969, an Increase of 3.6. For the control groups the 
corresponding scores were 58.9 In 1967, 66.2 In 1969, a difference of 7.3. This 
1st ar difference Is of special Interest; since the children In the control groups 
were not tutored. It presumably represents an Improvement In the performance of 
the classroom teachers. These data confirm subjective observations concerning 
such Improvement made by a nuDber of teachers and principals. The Hawthorne effect 
nay be responsible, but a more plausible account has been given by a number of 
teachers, who remarked that the tutoring of the problem readers gives them more 
time and Increases their effectiveness In teaching those children who are not 
tutored (Including, of course, the problem readers In the control group). 

Tutoring on Macmillan Material 

In schools using the Macmillan Basic Reader Series the tutoring was based on 
programs especially devised for use with this series. The materials used In tutor- 
ing Included the Macmillan first grade pre*-prlmers , primer and reader and the 
Macmillan workbooks. Sl^t-’readlng was tutored from the primers and reader ualng 
the same operational programs as are used with the Ginn series. Comprehension and 
word analysis was tutored from the workbooks, using operational programs similar 
to the Ginn Tutorial comprehension programs but modified to fit the format of Items 
In the MaoBlllan workbooks. 

Children In the Macmillan study were given the Metropolitan Reading Readiness 
Test, the Macmillan Vocabulary Recall test (an Individually administered test con- 
sisting of a random sample of 15 words In the Macmillan Pre-primer vocabulary, 
which the child Is asked to read), and the Alphabet test (arl Individually admin- 
istered test consisting of 28 upper and lower case letters, which the child Is 
••ked to Identify). Children were assigned to the experimental and control groups 
on the basis of the Metropolitan test scores, using the same procedure as was used 
in the Ginn study except that an equal number of children were assigned to the 
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two groups. Dot* In Table 2 Indicate that the two groups did not differ algnlfl- 
eantly on nny of th« throe pro~tosrsa 

Reading achievement at the end of the year was measured for both groups on 
the Macmillan Vocabulary Recall test, the Alphabet test, and on preliminary editions 
of the Maanlllan Mastery Tests designed to accompany the Primer (Woidds of Wonder ) 
and First Reader (Lands of Pleasure) . Mean scores obtained on these tests, 
together with the means for the total scores obtained on the last two, are shown 
In Table 3. All differences between the means for the experimental and control 
groups favor the experimental group and all are significant except for the Alphabet 
test. The magnitude of the differences on the Macmillan Primer and First Reader 
tests are larger than those obtained on the Ginn Primer and First Reader tests but 
no Interpretation can be placed on this fact since the tests of the two series are 
not comparable either In length or content. On appearance, however, the Macmillan 
and Ginn tutorial programs were equally effective. 

Effects of Previous Tutoring on Promotion and Retention 

A special study was made to examine the effects of the tutorial program 
carried out In 1966-67 upon retention and assignment to special education classes. 

A similar study was made of the effects of the 1967-68 tutorial program upon 
( 0 ( 0 ii(lon. The tutoring program In both studies utilized Ginn material only. 

Table 4 shows the class standings In May, 1969 of children who participated as 
experimental or control subjects In the evaluation of the tutorial program carried 

out with first grade children In 1966-67. 

The overall effect of tutoring upon class assignment was significant at 
the .05 level (jt? * 7.62, df • 2). Tutoring resulted In a 43X Increase In the 
proportion of children who were consistently promoted, a 25Z reduction In the 
proportion retained at the end of the first or second grade, and a 42Z reduction 
In the proportion aaslgned to special education classes. 
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CLASS STANDING IN 1969 FOR CHILDREN TUTORED IN 1966-67 





Tutored 


Control 


Change 

( 




(1966-67) 


(1966-67) 


vControl 


Tutored In 1966-67 


245 


126 




Located In Hay, 1969 


160 (65.32) 


88 (69.82) 




In 3d Grade In May, 1969 


94 (58.72) 


36 (40.92) 


+43. 5X 


In 2nd Grade In May, 1969 


49 (30.62) 


36 (40.92) 


-25.2% 


In Spec. Ed. In May, 1969 


17 (10.62) 


16 (18.22) 


-41. 8Z 


Total 


160 (1002) 


88 (1002) 





Table 5 shows the class standings In May, 1969 of children who participated 
as experimental or control subjects in the evaluation of the 1967-68 tutorial 
program. 



TABLE 5 

CLASS STANDING IN 1969 FOR CHILDREN TUTORED IN 1967-68 



^ Tutored In 1967-68 

Located In May, 1969 
In 2nd Grade In May, 1969 
In 1st Grade In May, 1969 
Total 
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Tutored 

(1967-68) 


Control 

(1967-68) 


Change 
/ Dlff . \ 
Control/ 


751 


108 




470 (62.62) 


64 (59.22) 




367 (78.12) 


38 (59.42) 


+31.52 


103 (21.92) 


26 (40.62) 


-46.12 


470 (1002) 


64 (1002) 
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The effect of tutoring upon class ssslgnsient (pronotlon vs. retention) vss 
significant at the .01 level 10.8, df ■> 1). Tutoring resulted In an increase 

of 31 per cent In the proportion of children proaoted and a reduction of 46 per 
cent in the proportion of children retained In the first grade. 

Conclusions 

1. The tutorial reading progran continues to produce large and statistically 
significant laprovenent In reading achlevenent. Rou|^ly equivalent gains were 
found for children tutored In Ginn material and for children tutored In an experi- 
mental program designed for use with the Kacnlllan Basic Keader Series. 

2. A follow-up of children tutored In 1966-67 and In 1967-68 showed that the 
retention rate was significantly reduced by the tutoring. 




